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Abstract 

Most neurons in the primary visual cortex initially respond vigorously 
when a preferred stimulus is presented, but adapt as stimulation contin- 
ues. The functional consequences of adaptation are unclear. Typically a 
reduction of firing rate would reduce single neuron accuracy as less spikes 
are available for decoding, but it has been suggested that on the popu- 
lation level, adaptation increases coding accuracy. This question requires 
careful analysis as adaptation not only changes the firing rates of neurons, 
but also the neural variability and correlations between neurons, which 
affect coding accuracy as well. We calculate the coding accuracy using 
a computational model that implements two forms of adaptation: spike 
frequency adaptation and synaptic adaptation in the form of short-term 
synaptic plasticity. We find that the net effect of adaptation is subtle and 
heterogeneous. Depending on adaptation mechanism and test stimulus, 
adaptation can either increase or decrease coding accuracy. We discuss 
the neurophysiological and psychophysical implications of the findings and 
relate it to published experimental data. 
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Introduction 



Adaptation, a reduction in the firing activity of neurons to prolonged stimu- 
lation, is a ubiquitous phenomenon that has been observed in many sensory 



brain regions, such as auditory Shu et al. 1993 Ulanovsky et al. 2004 , and 



somatosensory Ahissar et al. 2000 cortices, as well as in primary visual cortex 



(VI) [Ohzawa et al. 1982 Carandini and Ferster 1997 Gutnisky and Dragoi 



2008| . In addition to response reduction, adaptation has been observed to de- 



form the tuning curves Muller et al. 1999 Dragoi et al. 2000 Ghisovan et al. 



2008a|b , which is thought to lead to perceptual after-effects, such as the tilt 



after-effect Jin et al., 2005 Schwartz et al., 2007, Kohn 2007, Series et al. 



2009 Schwartz et al. 2009 



Adaptation is hypothesized to be functionally important for coding sensory 



information Kohn 2007 Schwartz et al. , 2007 . On the single neuron level, 
the reduction in firing rate should reduce coding accuracy, since it will typically 
become harder to discriminate two similar stimuli when firing rates are lowered. 
However, on the population level the accuracy is determined not only by the 
firing rates, but also by the correlations between neurons. In primary visual 
cortex it has been observed that adaptation reduces correlations, which can 



improve population coding accuracy Gutnisky and Dragoi 2008 . However, 
it is unknown how accuracy is affected when both changes in firing rates and 
changes in the correlations are taken into account. 

The coding accuracy of a population response can be analyzed using Fisher 
Information, which gives an upper bound to the accuracy that any decoder can 
achieve. Importantly, the Fisher Information takes the effects of correlations in 
neural variability (so called noise correlations) into account. Depending on the 
exact structure of the correlations, the Fisher Information can either increase or 



decrease with correlation strength Oram et al. 1998 Abbott and Dayan 1999 



Sompolinsky et al. 2002 Series et al. 2004 Averbeck et al. 2006 . Therefore a 



precise determination of the correlation structure is required, which is difficult to 
accomplish experimentally since vast amounts of data are required. Moreover, 
experimental probe stimuli that measure coding before and after adaptation can 
induce additional adaptation, possibly obscuring the effect of the adapter. 
Here we study this issue using a computational model of primary visual cor- 
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tex. We implement a variety of possible adaptation mechanisms and study cod- 
ing accuracy before and after adaptation. We find that the precise adaptation 
mechanism and its parameters lead to diverse results: accuracy can decrease but 
under certain conditions also increase after adaptation. The changes in tuning 
curves resulting in changes in coding are typically opposite from the changes in 
correlations. 



Methods 



Network setup 

The model of VI, Fig. [T|\, was a rate-based version of the ring model Ben- 



Yishai et al. 1995 Somers et al. 1995 Teich and Qian 2003 . The model 



did not pretend to be a full model of the visual system, but included essential 
cortical mechanisms that can produce adaptation. In the model, each of the N — 
128 neurons was labeled by its preferred orientation 9, which ranged between 
—90 and 90 degrees. The instantaneous firing rate Rg (spikes per second) was 
proportional to the rectified synaptic current. 



Re 



41], 



(1) 



where [x]^ = max(a::, 0). The constant b is the background firing rate and k 
represents the gain to produce the firing rate Rg for a given input /. Parameter 
values can be found in Table 1. We also used smoother rectification functions 



van Rossum et al. 2008 ; however, this did not affect the results. The above 



firing rate model had the advantage of being much more efficient than a spiking 



model, while Fisher information in spiking models [Series et al. 2004 and rate 



models Spiridon and Gerstner 2001 have been found to be qualitatively similar. 



Moreover, implementation of realistic variability across a wide range of firing 



rates is still a challenge in spiking models (for a review see e.g. Barbieri and 
Brunei! 12008] )■ 



For each neuron the synaptic current had a triple angular dependence and 
evolved in time according to 

a/(^,</),^,t) 



dt 



= -1(0, 0, V, t) + Iff (0, 0) + /exc(^, 0, ^, t) - linhiO, (/), 1^, t) - I,{,{0, 0, V, t) 



(2) 
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where ip is the adapter angle, 4> is the test stimulus angle, and r is the synaptic 
time constant 



Dayan and Abbott 2001 . The current consisted of 1) feed- 



forward excitatory input Iff from the LGN, 2) excitatory Icxc and inhibitory 
/inh input mediated by lateral connections with a center-surround (Mexican- 
hat) profile subject to short-term synaptic depression, and 3) an adaptation 
current Igfn which described spike frequency adaptation. 



Network connections 



The input Iff represented feed-forward excitatory input from LGN. Except for 
Fig. [s] it was assumed not to be subject to adaptation Boudreau and Ferster 



2005| . It was modeled as a Gaussian profile with periodic boundary conditions 
exp [- ^^ f'^ ) + exp ( — ^^-2---^l + cxp 



ls{0, 



Off 



2a| 



2a| 



-0-180)= 



where aff represents the Gaussian width of stimulus profile and aff its amplitude. 

Lateral connections mediated the excitatory (/cxc) and inhibitory (/mh) in- 
puts to neuron i according to 

Icxc{0t,4',ip,t) = gcxc £{0i, 0])xcxc{0] , cf), ip, t)Re, V', t) 

J 

j 

where 0j and 9i represented respectively the pre- and postsynaptic neurons, the 
constants g were recurrent gain factors, and R0{4>,'ip,t) was a noisy realization 
of the firing rate (see below). The variables x in Eq. Q represented the efficacy 
of the synapses subject to short-term plasticity (see below as well). 

The functions £ and I in Eq. ^ define the connection strength between 
cells 6i and 6j. We use Teich and Qian 2003 



£{e.,e,) = [CK{\e-e'\)]+ (5) 

and 

m,e,)^[-CK{\e^0'\)]+ (6) 

where 

K{9) = [cos (26*) + 1]^^="^ - [cos (261) + 1]^'"" , (7) 
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The functions £ and I were normalized with the constant C so that the sum of 
connections from any ceU to the rest equals 1, that is 1/C = |_fi'(6'i)|. 

The exponents ^oxc and control the range of interaction; the smaller 
they are, the flatter and wider the connection profile. We used a center-surround 
or Mexican-hat profile for the connection, satisfying ^cxc > ^inh, as in previous 



studies Ben-Yishai et al. 1995 Teich and Qian 2003 Series et al. 2004 . The 



precise profile of lateral inhibition is not well known. However, we found that 
in order to obtain sharpening (from a broad thalamocortical input to a sharp 
cortical neuron response. Fig. [T|3) the shape of inhibition was not critical, i.e. 
both long range inhibition or a fiat profile gave similar results. 



Synaptic short-term plasticity 

In the model cortical synaptic short-term depression affected the lateral connec- 



tions only; the afferents from the LGN did not depress Boudreau and Ferster 



2005 , Fig. SIC. We used a phenomenological model of short-term depression 



Tsodyks and Markram 1997 : The fraction of available neurotransmitter x of 



a syanpse of a presynaptic neuron with orientation 9 was 



dt 



where U is the release probability. The variable x ranged between zero and 
one, with zero corresponding to a fully depleted synapse and one to a non- 
depressed synapse. Before stimulation and in the control condition, all x were 
set to one. The constant t''^'^ was the recovery time from depletion to resting 
conditions. During prolonged stimulation, the steady state of the depression 



variable is smaller when the recovery time is slower, because Xoo = j 



We 



only included depression in the excitatory connections Galarreta and Hestrin 



1998 Teich and Qian 2003 Chelaru and Dragoi 2008 . We found that the 



opposite situation, namely stronger depression of inhibitory connections, lead 
to a unstable network activity. 
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Spike frequency adaptation 

Spike frequency adaptation was implemented using a standard first-order model 



Benda and Herz 2003 



dlsia.{e,(j),1p,t) T fa J. I ^\ , T} (A I 

Tsfa -Q-^ = -Isfa.[0,(P,iP,t) + ^sfa-Rfl (0, V, ■ 

The time constant Tstn was set to 50ms and the gain gsta, was chosen so that 
the firing-rate reduction of the neuron to the adapter stimulus is comparable to 
that produced by synaptic depression. 

Variability model 



The responses of cortical neurons are typically highly variable, e.g. Tolhurst 



et al. 1983 . To fit our noise model we used extracellular single unit recordings 



from neurons in area VI of macaque presented with 300 ms stimuli Oram 



et al. 1999 . For each recorded cell, the grating orientation that elicitepd the 
maximal response was labeled as the "preferred orientation" (peak), and all 
orientations were given relative to the peak (22.5, 45, 67.5 and 90 degrees). 
For n=19 different cells, 8 different orientations were tested with 3 stimulus 
types: gratings, bars lighter than background, bars darker than background. 
The spike rate was counted in 50 ms bins. The firing rate for each orientation 
was calculated as the arithmetic mean across the different stimulus types. In 
addition, symmetric orientations (e.g. peak at +22.5 degrees and peak at - 
22.5 degrees) were collapsed, yielding 60 trials for the peak and the orthogonal 
orientation and 20 trials for all other orientations. The variability was expressed 
in terms of the Fano Factor (FF), which is the spike count variance across 
trials divided by the mean spike count. We found that the FF was to a good 
approximation constant across time and independent of stimulus orientation, 
nor did the Fano Factor depend on the firing rate, implying that the noise was 
multiplicative. 

To model this variability we added multiplicative noise to each neuron's 
activity. The noise is added after its input current is converted to the firing rate 
Eq[l] and noise reflects the stochastic nature of spikes generation. We set 

Re^Re + a{Re)r]{t), 
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where the noise 77 was Gaussian white noise, i.e. {r]{t)) = 0, and {r]{t)rj{t')) = 
5t,t' : and Re denotes the average over ah the trials. Note that the noise is tem- 
porally uncorrelated, reflecting the approximate Poisson-like nature of cortical 
activity. Note that although the added noise is temporally and spatially un- 
correlated, the synaptic coupling between the neurons will mix the noise from 
different neurons, resulting in correlated noise. 

To achieve a given Fano Factor in the model, the required amplitude of the 
noise was set according to (j{Rg) = VFF \/^Re. A sample trial is illustrated in 
Fig. [1J3 (red dots) . To study how the trial-to-trial variability of the single cell 
affects the population coding, we ran simulations using FF= 0.50,1.00,1.50, 
Fig. [5p-D. In addition, to further investigate the generality of our results we 
used two alternative noise models; 1) Poisson distributed firing rates with mean 
R (unity Fano Factor), and 2) additive Gaussian white noise. We found that, 
although the absolute scale of the Fisher Information differed, the adaptation 
affected the information exactly identically for all test angles. In other words 
the effect of the adaptation was independent of exact noise model. 

For the common input noise model. Fig. [7j the feedforward input was cor- 
rupted with a multiplicative noise source that was identical on a given trial for 
all neurons ls{0, 0) = (1 + ri)Iff{9, (jj), where rj was a Gaussian random number 
with zero mean and unit variance. 



Correlated variability 



In the visual cortex the response variability is correlated Nelson et al. 1992 



Gawne et al. 1996 Kohn and Smith 2005 . In the model these correlations 



result from the lateral connectivity Series et al. 2004 . The covariance matrix. 
Fig. [3] top row, across trials was defined as 

g,, (0, ^) = ( [R, (0, V) - i?, (0, V^)] [Rj (0, V) - i?j (0, ^)] ) , 

where Ri = Re- was the firing rate of neuron i and R the average across tri- 
als. Although only the g-matrix enters in the Fisher Information, experimental 
data is often reported using normalizef correlation coefficients. The (Pearson-r) 
correlation coefficient Cij was obtained by dividing the covariance matrix by the 
variances, Cij = qij/[\/ var {Ri)y/ var (Rj)], Fig. [sjbottom row. 
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The Mexican-hat connectivity produced a covariance matrix with both pos- 
itive and negative correlation, corresponding to excitatory (slrort range) and 



inhibitory (long range) lateral connections, similar to other models Spiridon 
and GerstneTl|2001[[SCTies et al.[|2004 



Accuracy of population coding 

To quantify the accuracy of the population code we used the Fisher Information, 
which is a function of the tuning of individual neurons and the noise correlations, 
which for Gaussian distributed responses equals 

FI(0,V) =FIi(0,V)-HFl2(0,V'). 
The first term is given by 

Fii(</.,v) = ^^i?:(0»9.^-\</',V') (8) 

i J 

where R' denotes first derivative of R with respect to the stimulus orientation 
0, and q^j^ is the inverse covariance matrix. Note that in contrast to population 
coding studies with homogeneous tuning curves where the FI is constant, here 
the FI depends both on the stimulus angle of adapter ip and the stimulus angle 
of the probe. The second term equals 

i,j,k.l 

For a covariance matrix independent of the stimulus orientation q'{4>, ip) — 0, so 
that FI2 ((/),'(/') = 0. 

To calculate the derivatives appearing in Eqs.(|8]) and we discretized 
the stimulus space with a resolution of ft, = 180/A^, with N the number of 
neurons. The first derivative of the tuning curve of the neuron i was computed 
as i?^ (0,-0) = [Ri{(l> + h,i/j) — Ri{(f) — h,ip)]/{2h), and similar for the derivative of 
the correlation matrix in Eq. ^ . To accurately estimate the Fisher Information 
we used 12,000 trials for each data point, as too few trials lead to an overestimate 
of the Fisher Information (by some 5% when using only 4000 trials). 

Both contributions to the Fisher Information, given by Eqs.|8]and[9l were af- 
fected by visual adaptation. Interestingly, both showed strikingly similar effects 
of adaptation. Fig. [5K-B. Although quantitatively the FI2 was much smaller 
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than FIi for the given number of neurons, the second term is extensive in the 
number of neurons, even in the presence of correlations, in contrast to the FIi 



term which saturates when correlations are present Shamir and Sompolinsky 



2004 . Because the almost identical effects of adaptation on the two terms, the 
effect of adaptation on the sum of the two terms will be independent on their 
relative contribution, suggesting that our results will be valid for a wider range 
of neuron numbers. 

The Fano Factor dependence for both terms can be analytically calculated; 
applying the Fano Factor definition, the covariance matrix is qij {(j), ^p) — FFji?^ ip)5i^j + 
Ci-iict), '4>)\/Y¥i^¥¥j Ri{4>, V'), where Cij are pairwise correlations. 



For a population of neurons with the identical FF (as is the case here), FIi 
scales with 1/FF, while FI2 is independent of FF for our noise model; this is 
illustrated for the control condition in Fig. [5] bottom row. 

Simulation protocol 

The adaptation protocol is illustrated in Fig.jlp. For each trial, we ran the net- 
work without input until the neural activity stabilized (~ 150ms), after which 
an adapter stimulus with orientation ip was presented for 300 ms during which 
the network adapted. After this adaptation period, the adaptation state of the 
network was frozen, i.e. no further adaptation took place. The response to 
a stimulus with orientation (p was tested, which again required an equilibra- 
tion of the network activity (450ms). The activity at the end of this period 
corresponded to a single trial response. 

Decoders 

We measured how adaptation modified the performances of two decoders or 
estimators: a Population Vector decoder and a winner-take-all decoder [Jin| 
et al. |2005| . For winner-take-all decoding the estimate was simply the (non- 



adapted) preferred orientation of the neuron with highest firing rate. For the 
population vector decoder the responses of all neurons were vector summed with 
an orientation equal to the neuron's preferred orientation before adaptation. 

For each decoder, we computed both the bias b{9) and the discrimination 
threshold T{9). The bias is the difference between the mean perceived orienta- 
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tion and the actual presented stimulus orientation. The discrimination threshold 
follows from the trial-to-trial standard deviation in the estimate, a{9) as 

Da{0) 



(10) 



1 + b'{e) 

where D is the discrimination criterion, chosen to be 1, corresponding to an 
error rate of ^ 76%. The Cramer-Rao bound on the discrimination threshold is 



given by Series et al. 2009 



T{d) > 



D 



(11) 



Results 



To study how adaptation affects coding, we used a well studied recurrent net- 



work model of area VI, the so called ring model Ben-Yishai et al. 1995 Somers 



et al. 1995 Teich and Qian 2003 . Neurons in the network were described by 



their firing rate and received feedforward input from the LGN and lateral input 
via a center-surround profile. Fig. [T|\-B and Methods. 

Neural adaptation occurs through multiple mechanisms. Here we focused 
on two distinct mechanisms both believed to contribute significantly to the 
adaptation of the neural responses to prolonged stimulation: 1) Spike frequency 
adaptation (SFA), in which the neuron's firing rate decreases during sustained 
stimulation [Sanchez- Vives et al. 2000a|b Benda and Herz 2003 , and 2) short- 
term synaptic depression (SD) of the excitatory intracortical connections, so 



that sustained activation of the synapses reduces synaptic efficacy Finlayson 



[and CynadeTl [T9951 [Varela et al.j [T9971 [Chung eTaLj [20021 [Best and WHsoill 



2004 . Synaptic depression is comparatively strong in visual cortex as compared 



to other areas Wang et al. 2006 



In the adaptation protocol. Fig. [Tp, an adaption inducing stimulus with 
an angle ijj was presented for 300 ms, after which the population response to 
a test stimulus with orientation (j) was measured. To insure that the models 
were comparable, the parameters were set such that the adaptation mechanisms 
reduced the firing rates of neurons tuned to the adapter orientation equally, see 

Fig.im-B. 
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Effect of adaptation on single neuron tuning 

First we studied how the different adaptation mechanisms changed the single 
neuron tuning curves. Note that in homogeneous ring networks the response 
of a neuron before adaptation is a function of a single variable only, namely 
the difference between the stimulus angle (j) and the neuron's preferred angle 
9. Adaptation, however, renders the system inhomogeneous and the responses 
were characterized by three angles: The angle of the adapter stimulus ^, set to 
degrees, the angle of the test stimulus, and the preferred orientation of the 
neuron. (Note that the preferred orientation of a neuron refers to its preferred 
orientation before adaptation). 

Both SD and SFA reduced the responses of neurons at the adapter orienta- 
tion, in addition the tuning curves deformed, see Fig. [2j\-B. We characterized 
the effect of adaptation on preferred orientation shift, tuning curve slope and 
tuning curve width: 

Tuning curve shift (Fig. [^Cj: Adaptation shifts the tuning curve (char- 
acterized by the center of mass). For both SD and SFA the tuning curves 
shifted towards the adapter stimulus. Attractive shifts after adaptation have 
been reported before in VI Ghisovan et al. 2008a|b , and in area MT [Kohn 



and Movshon 2004 , although repulsive shift have been observed in VI as well 



Muller et al. 1999 Dragoi et al. 2000 



Tuning curve slope (Fig. [^D/- The derivative of the firing rate with respect 
to stimulus angle, or slope, is an important determinant of accuracy. In the 
absence of correlations the Fisher information is proportional to the slope (see 
Eq. ([s]). Methods). We plotted the slope of the tuning curve as a function 
of the test orientation for a neuron responding preferentially to the adapter 
orientation. For test angles close to the adapter orientation (<20 degrees), SD 
reduced the absolute value of slope relative to the control condition (solid line) , 
but SFA increased the slope. Thus, for this neuron the increase in the slope 
occurring for SFA increases the coding accuracy around those orientations. For 
test angles further from the adapter orientation (ranging from 45 to 57 degrees) 
both SD and SFA showed a decreasing slope. 

Tuning curve width (Fig.^p): The width was computed as the angular range 
for which the neuron's response exceeded the background firing rate. (Similar 
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results were obtained using the width at half height). For both SD and SFA 
the width narrowed close to the adapter orientation and widened at orthogonal 
angles. 



Effects of adaptation on noise correlations 

Coding accuracy is not only determined by the properties of the single neu- 
ron tuning curves, but also critically depends on the noise in the response and 



the correlations in the noise between the neurons Abbott and Dayan 1999 



Sompolinsky et al. 2002 Gutnisky and Dragoi 2008 . These noise correlations 



describe the common fluctuations from trial to trial between two neurons. The 
noise was modelled by independent multiplicative noise to the firing rates of 
the individual neurons, mimicking the Poisson-like variability observed in vivo 
(Methods) . In the model direct and indirect synaptic connections lead to corre- 
lations in the activity and its variability. For instance, if a neuron is by chance 
more active on a given trial, neurons which receive excitatory connections from 
it will tend to be more active as well. 

We first studied the correlations in the control condition. Fig. [3|V top illus- 
trates them for a stimulus angle of zero degrees. In analogy with experiments 
we also characterized them by the Pearson-r correlation coefficients. The corre- 
lation coefficients in the control condition arc shown in Fig. [Sj'V, bottom. Only 
neurons with a preferred angle between approximately -45 and +45 degrees were 
activated by this stimulus (the square region in the center of the matrix), and 
could potentially show correlation. 

The correlations were strongest for neurons with similar preferred angles but 
that responded quite weakly to the stimulus, while neurons that had approxi- 
mately orthogonal tuning (-45 and +45 degrees) showed negative correlation, as 
observed previously Spiridon and Gerstner 2001 Series et al. 2004| . The rea- 
son is that the noise causes fluctuations in the position of the activity bump (the 
attractor state) in the network, while its shape is approximately preserved. In 
nearby neurons for which the stimulus was at the edge of their receptive fields, 
such fluctuation lead to large, common rate fluctuations and hence strong cor- 
relation. In contrast, the responses of neurons in the center of the population, 
although noisy, were only weakly correlated as the precise position of the at- 
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tractor state hardly affected their firing rates. 

Adaptation led to changes in the noise correlation, Fig. |3j3-C, bottom row. 
Spike frequency adaptation (SFA) increased noise correlations, whilst synaptic 
depression (SD) decreased them. The latter is easy to understand. Synaptic de- 
pression weakens the lateral connections, and thus reduces correlations, shifting 
the operation of the network toward a feedforward mode. Fig.[3|l) shows the cor- 
relations between neighbouring neurons, showing the shape of the correlations 
and the effect of the adaptation in one graph. 

Effect of adaptation on coding accuracy 

Next we combined the effects of adaptation on tuning curves and correlations 
to calculate population coding accuracy as measured by the Fisher Information, 
see Methods. The Fisher Information before and after adaptation is plotted as 
a function of test orientation in Fig. |4]A_. Before adaptation the information is 
independent of the test angle as the network is homogeneous (solid line). After 
adaptation, the information becomes dependent on test angle (dashed curves). 

Only for SFA and only for test angles close to the adapter, the Fisher Infor- 
mation and hence accuracy increased. This peak was caused by the sharpening 
of the tuning curves near the adapter angle (see below). For all other combina- 
tion of test orientation and adaptation mechanism the Fisher Information was 
slightly reduced. Interestingly, the shapes of the curves for SD and SFA are 
similar in that the Fisher Information peaked at the adapter angle. 

Next, we explored the effect of the correlations on the information. We 
shuffled responses effectively removing any correlations. We subtracted the 
full Fisher Information from the Fisher Information using shuffled responses, 
Fig. |4j3. That this difference was always positive indicates that correlations al- 
ways reduced the accuracy. After SD adaptation shuffling led to smaller increase 
than in control, consistent with the de-correlation caused by synaptic depres- 
sion. For SFA the effect of correlations was more dominant for orientations close 
to the adapter angle, consistent with Fig.|3p, and decreased for orientations far 
from the adapter angle. 

As both individual tuning curves and the correlations change under adap- 
tation, we further distinguished their contributions to the Fisher Information. 
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First, we calculated the Fisher Information using adapted tuning curves and 
non-adapted correlations, Fig. |4p. Because the correlations were now fixed to 
the control condition, changes in the Fisher Information are a consequence of 
the changes in tuning curves only. The Fisher Information resembled Fig. |4]4., 
indicating that the deformations of the tuning curves are important. For SFA, 
the tuning curve slope increased near to the adapter angle, Fig. [2jl), resulting 
in a prominent peak in the Fisher Information. 

Finally we calculated the Fisher Information using non-adapted tuning curves 
but adapted correlations to reveal the information changes due to changes in 
correlations only. Fig. |4jl). Consistent with Fig.|3j3-C, with synaptic depression 
the Fisher Information increased for most orientations as the correlations are 
reduced. Also for SFA, the Fisher Information increased at almost all stimu- 
lus angles, except at a stimulus angle of zero degrees. In summary, when only 
adaptation of the correlations was taken into account, the information increased 
for most conditions. This finding is consistent with recent experimental data 



Gutnisky and Dragoi 2008 , where adaptation of the noise correlations were 



shown to increase population accuracy. 

Although we typically observed opposite effects of changes in tuning curves 
and changes in correlation on the information (Fig. |4]C-D), the total effect of 
the adaptation on coding is not simply the linear sum of the two. They interact 
non-linearly and therefore the total adaptation induced change of the Fisher 
Information in Fig. [4|V is different from the sum of Fisher Information changes 
from Fig. |4p-D. 

The Fisher Information can be split in two terms, FIi and FI2 (see Meth- 
ods). Both contributions to the Fisher Information, given by Eqs. [8] and |9) 
were affected by visual adaptation. Interestingly, both showed strikingly similar 
effects of adaptation, Fig. [5|V-B. Although quantitatively the FI2 was much 
smaller than FIi for the given number of neurons, the second term is extensive 
in the number of neurons, even in the presence of correlations. This is unlike the 



FIi term which saturates when correlations are present Shamir and Sompolin- 



sky 2004 . Because the almost identical effects of adaptation on the two terms. 



the effect of adaptation on the sum of the two terms will be independent on 
their relative contribution, suggesting that our qualitative results will be valid 
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for a wide range of neurons numbers. 



Reading out the population code 

Because it is not known how populations of neurons are read-out by the ner- 
vous system, we analyzed how two well-known decoders, the winner-take-all 
and the Population Vector decoder, are affected by adaptation (see Methods). 
Importantly, if the decoder does not have access to the state of adaptation, as 



we assumed here, its estimate will typically be biased Series et al. 2009 . For 
the two decoders, the bias profile was virtually identical, Fig. [6]A_-B. Both SD 
and SFA led to strong tilt after-effects (repulsive shift away from the adapter 
orientation). As observed before, the tuning of individual neurons can behave 



differently from the population tuning Teich and Qian 2003 . The population 
bias can be opposite from the individual tuning curve shift, cf. Fig. |6]to Fig. 
[2p. The reason is that the population vector weighted individual responses ac- 
cording to their firing rate. Therefore, although a neural tuning curve could 
shift towards the adapter orientation, if the rate were sufficiently reduced, the 
population vector would shift away from the adapter orientation. 

For unbiased estimators the Cramer-Rao bound dictates that the minimum 
obtainable variance is given by the Fisher Information. For biased estima- 
tors where the bias is non-uniform this is no longer true. Instead, for biased 
estimators, the Fisher Information forms a bound on the decoder's discrimi- 
nation threshold (see Methods and Series et al. 2009| ). Conveniently this is 
also the quantity that is typically assessed psychophysically. The discrimina- 
tion threshold in the angle estimate in the two decoders is shown in Fig. [6p-D. 
The threshold is inversely proportional to the Fisher information. Interestingly, 
for the winner-take-all decoder not only SFA but also SD increase performance 
at zero degrees. This is further illustrated in panel E-F, where the threshold is 
plotted relative to the Fisher Information. This ratio is a measure of the biased 
decoder efficiency, a value of one indicating a perfect decoder. Unsurprisingly 
the population vector decoder (Fig. [6^5) is more efficient than the winner-take- 
all (Fig.[6|i^), which, unlike the population vector, does not average over neurons 
to reduce fluctuations. 
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Effect of common input noise 

In our model the correlations were typically weak(< 0.03) and neurons with or- 
thogonal preferred angles were anti-correlated. With the exception of a recent 



study Ecker et al. 2010 , electrophysiological data in visual cortex, however, 



show stronger correlations among nearby neurons with similar preferred orien- 
tation 0.2) and typically less for neurons with different preferred orientations 



Nelson et al. [1992 Gawne et al. 1996 DeAngelis et al. 1999 Smith and Kohn 



2008 . In addition, pairwise correlations were found to be only weakly depen- 



dent on stimulus orientation Kohn and Smith 2005 . This suggests that there 



is an additional source of correlation in the data. In particular, common input 
noise from the LGN input could be the source of this missing correlation. We 
implemented LGN noise in the model that introduced common fluctuations in 
VI, enhancing the noise correlation. Fig. [7] right column. Although the com- 
mon input noise substantially increased the correlations, the effect on the Fisher 
Information is negligible, cf. Fig. [7] bottom row. The limited effect of common 
input noise on the coding accuracy can be understood from the fact that com- 



mon input noise can be extracted away by a decoder Sompolinsky et al. 2002 



A decoder can first calculate the population averaged activity on each trial, and 
decode relative to this average activity. 



Effect of input adaptation 



Although there is evidence that in the LGN input does not adapt Boudreau 



and Ferster 2005 , we also tested the case where the input did adapt through 



synaptic depression. Parameters were adjusted so that the same response re- 
duction after adaptation was achieved as SD and SFA. The adaptation reduces 
the drive to the VI network. The adaptation effects on tuning curves and 
Fisher Information are shown in Fig. [8] These results are very similar to SD. 
However, in contrast to SD, the correlations before and after adaptation were 
virtually identical (not shown), as adapting the input did not affect the lateral 
connections. 
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Discussion 



We built a recurrent network model of primary visual cortex to address how 
adaptation affects population coding accuracy. Although a variety of models 



have modeled adaptation by imposing changes in the tuning curves, e.g. Jin 



et al. 2005 , our model is the first to model the adaptation biophysically, thus 



directly relating biophysical adaptation to coding. From the adaptation mech- 
anism, it predicts the concurrent changes in tuning curves, correlations, and 
coding. For synaptic depression (SD), we observed at the adapter orientation a 
strong reduction of tuning curve width, attractive shifts of the individual tun- 
ing curves, and strong repulsive population shifts. The case of spike frequency 
adaptation (SFA) was qualitatively comparable to SD with regards to tuning 
curves, but the changes in the coding accuracy were distinct (see below). 

Experimental data on tuning curves changes after adaptation are diverse 
and sometimes contradictory. Increased widths at the adapter orientation and 



repulsive shifts have been reported in VI Dragoi et al. 2000 , while other studies 
in VI reported a width reduction to the adapter stimulus and repulsive shifts 



MuUer et al. 1999 . Yet another study reported attractive and repulsive shifts, 



with no explicit quantification of width variations of the tuning curves Ghisovan 



et al. 2008a|b . Finally, electrophysiological data from direction selective cells 



in area MT show a strong narrowing at the adapter orientation and attractive 



shifts Kohn and Movshon , 2004 



Next, we examined the effect of adaptation on coding accuracy by means of 
the Fisher Information. We studied how Fisher Information depends on test ori- 
entation and precise adapting mechanism. The Fisher Information represented 
in Fig. [4]4. showed larger Fisher Information for orientations close to the adapter 
orientation in the case of SFA. This was due to the increased slope of the tuning 
curves after adaptation. The increase in information occured despite increased 
noise correlations. In the case of SD adaptation the accuracy reduced, despite 
a reduction in the correlations, Fig. [3] This reduction was however not enough 
to counter the reduction in accuracy due to tuning curve changes. Fig. [4p. 

We also considered the case where the input connections are adapting. It 
should be noted that whether the LGN-Vl connections are subject to short term 



synaptic depression is matter of debate Boudreau and Ferster 2005 Jia et al. 
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2004 . Inclusion of synaptic depression in the LGN-Vl connections reduced the 



drive of VI for neurons close to the adapter. The results for both the tuning 
curve and Fisher Information changes is very comparable to SD, Fig. |8] 

To compare these findings to psychophysics we implemented two common 
decoders which yield adaptation-induced biases and accuracy. Both decoders 
showed repulsive tilt after-effects. Both attractive and repulsive have been re- 
ported experimentally, typically showing repulsion close to the adapter and 



attraction far away Schwartz et al. , 2007 Clifford et al. 2000 Schwartz et al 



2009 . Although we do find repulsion close to the adapter, attraction for orthog- 



onal orientation is not reproduced here. This could be due either to differences 
in the activity or to a different readout mechanism. Data on orientation discrim- 
ination performance after adaptation is limited, although it has been argued to 



resemble motion adaptation Clifford[ 2002 , for which more data is available, 
see e.g. 



Series et al. , 2009 . Similar to the case of SFA, two studies found a 



slight improvement around degrees, but a higher (worse) threshold for inter- 
mediate angles [Regan and Beverley 1985 Clifford et al. 2001 . One study 



found a lower (better) threshold for angles close to 90 degrees Clifford et al 



2001 , not present in our simulations. 



Model assumptions and extensions 

As any model, this model has certain limitations and is based on a number of 
assumptions. First, the model is not spiking, but rate based. Of course a spiking 
model is in principle more realistic and could lead to different results, but apart 
from the difficulty tuning a spiking network model, in particular obtaining the 
right noise and correlations is far from trivial, such a model would be computa- 
tionally challenging given the number of trials required to calculate the Fisher 
Information. Encouragingly however, in studies of non-adapting networks, a 
rate model with phenomenological variability lead to a similar covariances as a 



network with spiking neurons Spiridon and Gerstner 2001 Series et al. 2004 



We assumed that the noise stems either from the neurons in the network 
or from common LGN modulation. Additional sources of noise do probably 
exists, including correlated noise sources such as other common input, common 
feedback, or common modulation, both stationary and adapting. Although such 



19 



noises could be included in the model but too little is known about noise sources 
to allow for strong conclusions on this point. 

Our model focusses on brief adaptation paradigms of up to a few hundred ms, 
as cellular and synaptic adaptation is best characterized on those time scales. 
We have modelled simplified versions of synaptic and cellular adaptation that, 
although these phenomological models are well supported by empirical data, 
are known to be much more complicated biophysically and manifest multiple 
non-linearities and timescales. For longer adaptation periods, other adaptation 



processes might be activated, e.g. Sanchez- Vives et al. 2000b Wark et al. 



2007 , which would require modified adaptation models. Despite these limita- 



tions, one could in principle consider cases where the network is continuously 
stimulated, as would occur under natural stimulation. Our results suggest that 
the coding accuracy would show a strong history depedence. Furthermore, the 
net effect of the synaptic depression is expected to be less, as the synapses will 
be in a somewhat depressed state already. Unfortunately, a detailed analysis of 
this scenario seems currently computationally prohibitive. 

Finally, we assumed a model in which the tuning curves are sharpened by the 
recurrent connections. Previous studies, without adaptation, have contrasted 
coding in such networks with coding in feedforward networks with no or much 
less recurrence and found that the recurrence induces correlations that strongly 



degrade the coding Spiridon and Gerstner 2001 Series et al. 2004 . Inline with 
those findings, we find that the correlations induced by the recurrent connec- 
tions, severly reduce the information, see Fig. [4p. Whether the primary visual 
cortex is recurrently sharpened or dominated by feed-forward drive is a matter of 



debate Ferster and Miller 2000 . In the feedforward variant of our model with- 
out any recurrence, noise correlations will be absent. Thus the tuning curves 
and the noise determine the information content and the changes caused by 
adaptation. This situation is comparable to calculating the information using 
uncorrelated (i.e. shuffled) responses. Fig. |4|3. 

In summary, adaptation strongly reduces neuronal activity but the post 
adaptation changes in tuning curves and correlations and hence coding accuracy 
depend strongly on the biophysical details of the adaptation mechanism. 
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Figure 1: Network architecture, response and adaptation protocol. 

A: The network architecture consists of a recurrent network in which neurons 
receive feedforward input from the LGN and lateral input with short range ex- 
citation and long range inhibition (Mexican hat profile). Periodic boundary 
conditions (not shown) ensured a ring topology of the network. B: Model be- 
havior: The cortical neurons (green line) sharpened the input from LGN (blue 
line; scaled 15 times for clarity). On aSfngle trial the multiplicative noise leads 
to substantial variability (red dots). C: Schematic of the adaptation protocol. 
During 300 ms the network is adapted to a stimulus with orientation ijj = 0, fol- 
lowed by a test phase with stimulus with orientation </) during which no further 
adaptation takes place. 
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Figure 2: Effect of adaptation on the tuning curves of individual neu- 
rons. A-B Tuning curve properties for the different adaptation meclranisms: 
synaptic depression (SD) and spike- frequency-adaptation (SFA). Individual neu- 
ron tuning curves before and after adaptation. The tuning curves are shown for 
neurons with a preferred orientation of (green), 45 (red) and 90 (blue) degrees, 
before (solid lines) and after adaptation (dashed lines). The adapter orienta- 
tion was set to zero degrees (marked with an arrow in panel A). C-E Changes 
in tuning curves properties after adaptation. C: Postadaptation tuning curve 
shift (center of mass) for all neurons. Both SD and SFA yielded an repulsive 
shift towards the adapter. D: The slope of the tuning curve of a neuron with 
preferred orientation of zero degrees (green curve in panels A-B) as a function 
of the test orientation. The absolute value of the slope at small test angles 
increased with SFA, whilst the slope decreased with SD adaptation. E: The 

change in the tuning curve width for the neurons in the population with respect 
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to the control condition. For both SD and SFA the tuning curves narrowed for 
neurons with a preferred angle close to the adapter orientation, and widened far 
from the adapter orientation. 




-90 -45 45 90 



preferred orientation neuron j (deg) 



D 



o 



TO 
03 



O 
O 



0.03 
0.01 



S -0.01 



J2 



-0.0 




-control 

■SD 

-SFA 



-^0 -45 45 90 
preferred orientation neuron i (deg) 



Figure 3: Effects of adaptation on the noise correlations. On top row, the 
covariance matrices are plotted such that each point at the surface represents 
the noise covariance between two neurons with preferred orientation given by 
X and y-axis. On bottom row, the covariance matrices were normahzed to the 
noise (Pearson-r) correlations coefficients. The principal diagonal was omitted 
for clarity. Compared to the control condition (panel A), synaptic depression 
(SD) reduced noise correlations (panel B), while spike frequency adaptation 
(SFA) increased them (panel C). D. The noise correlations coefficients depicted 
between neighboring cells (i.e. c^^i+i), for the three conditions. Adaptation 
through SD reduces the correlations, SFA increases them. In all panels the 
adaptor and test orientation were set to degrees. 
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Figure 4: Effect of adaptation on population coding accuracy. A: 

Fisher Information as a function of test orientation, in the control condition, 
i.e. before adaptation, and after adaptation through synaptic depression (SD) 
and spike frequency adaptation (SFA). Compared to the control condition the 
Fisher Information increases for SFA, provided the test stimulus orientation was 
similar to the adapter orientation. In all others cases a slight reduction of the 
accuracy is seen. B: The additional information when the noise correlation is 
removed by shuffling the responses. The difference of Fisher Information using 
original responses (as panel A) and shuffled responses is shown. In all cases, 
including control, shuffling increases the information. For SD as after adaptation 
the population response is partially decorrelated, less information is gained by 
shuffling than in the control condition. For SFA the effect is heterogeneous, 
indicating that adaptation effects of the noise correlations for SFA were high for 
orientations close to the adapter orientation and less dominant far from it. C: 
Fisher Information using adapted tuning curves and non-adapted correlations. 
D: Adapted correlations with non-adapted tuning curves. Using non-adapted 
tuning curves, the decorrelation for SD adaptation increased Fisher Information. 
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Figure 5: Contributions to the constituents of the Fisher Information. 

The Fisher Information is the sum of the term FIi (left) and FI2 (right), see 
Eqs. [8] and |9] A-B: FIi and FI2 for the adaptation scenarios compared to the 
control situation. The effect of the adaptation dependence was similar, although 
the second term was an order of magnitude smaller. C-D: Dependence of FIi 
and FI2 on the Fano Factor (FF), using Gaussian multiplicative noise. Only 
the control situation (before adaptation) is plotted, as the scaling before and 
after adaptation is identical. 
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Figure 6: Decoding bias and variance. A-B: The bias (average estimated 
orientation minus actual orientation) for two decoders: the population vector 
and winner-take-all decoder. SD and SFA adaptation induced a positive bias for 
estimations of positive orientations and negative bias for negative estimations 
(i.e. a repulsive shift of the population). C-D: The discrimination threshold of 
the decoders is inversely proportional to the inverse of the Fisher Information, 
Fig. |4]'V. E-F: The discrimination threshold relative to the Fisher Information. 
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Figure 7: Effect of common input noise on correlation and coding. 

Compared to the situation without common noise (first column) , after the inclu- 
sion of common noise input (second column) the correlation structures changed 
significantly. With common input the correlations increased from less than 0.1 
to 0.4, and the correlations became weakly dependent on the stimulus orienta- 
tion. Because the LGN input did not depress, changes in the correlations were 
practically unaffected by adaptation. However, the common noise did not mod- 
ify the information (bottom panels). For clarity, only adaptation trough SD is 
shown; the same holds for SFA. 
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Figure 8: The effect of input adaptation on tuning curve properties 
cuid Fisher Information. In this simulation the input current was adapted. 
The strength of adaptation was adjusted to have a similar amount of reduction 
in the peak response. No other adaptation mechanism was active. The changes 
in tuning curve and Fisher Information are very similar to the changes seen with 
SD. 
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Tables 



Table 1: Symbols and parameters used in simulations. The parameters 
for SD and SFA were chosen to achieve the same control conditions, and a 
similar response reduction after adaptation for the neuron maximally responding 
at the adapter orientation. Finally all parameters were restricted to be in the 
physiologically plausible range. 



Meaning 


Symbol 


Value 


neuron's preferred orientation 


6 


(-90,90) degrees 


adapter orientation 


V' 


degrees 


test orientation 




(-90,90) degrees 


time decay of synaptic current 


r 


10 ms 


amplitude of thalamocortical input 


Off 


4.0 


Gaussian width of thalamocortical input 




45.0 


gain Tor excitatory iuiracorticai input 




0.2 


interaction power for excitatory connections 


A 

-^exc 


2.2 


gain for inhibitory intracortical input 


S'inh 


2.5 


interaction power for inhibitory connections 


^inh 


1.4 


probability of excit. transmitter release 


u 


0.02 


recovering time for synaptic depression 


T 


600 ms 


background firing rate 


b 


4Hz 


input current to firing rate gain 


K 


4.0 Hz 


Fano Factor 


FF 


1.5 


time decay for spike frequency adaptation (SFA) 


Tsfa 


50 ms 


gain for spike frequency adaptation 


5sfa 


0.05 
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